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Abstract 

Wc study the generalization of split and intersection cuts from Mixed Integer Linear Pro- 
gramming to the realm of Mixed Integer Nonlinear Programming. Constructing such cuts 
requires calculating the convex hull of the difference of two convex sets with specific geometric 
structures. We introduce two techniques to give precise characterizations of such convex hulls 
and use them to construct split and intersection cuts for several classes of sets. In particular, we 
give simple formulas for split cuts for essentially all convex sets described by a single quadratic 
inequality and for more general intersection cuts for a wide variety of convex quadratic sets. 
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1 Introduction. 



An important area of Mixed Integer Linear Programming (MILP) is the characterization of the 
convex hull of specially structured non-convex polyhedral sets to develop strong valid inequalities 
or cutting planes such as split and intersection cuts [22, 23, 25, 31]. This approach has led to 
highly effective branch-and-cut algorithms [1, 15, 16, 45, 50], so there has recently been signif- 
icant interest in extending the associated theoretical and computational results to the realm of 
Mixed Integer Nonlinear Programming (MINLP) [6, 7, 10, 17, 20, 26, 27, 28, 33, 46, 67]. Unfor- 
tunately, this extension requires the study of the convex hull of a non-convex and non-polyhedral 
set, which has proven significantly harder than the polyhedral case. Most of the known results in 
this area are limited to very specific sets [44, 66, 68] or to approximations of semi-algebraic sets 
through Semidefinite Programming (SDP) [35, 49, 56, 57, 58, 60, 61]. While some precise SDP 
representations of the convex hulls of semi- algebraic sets exist [40, 42, 43, 65], these require the use 
of auxiliary variables. Such higher dimensional, extended, or lifted representations are extremely 
powerful. However, there are theoretical and computational reasons to want representations in the 
original space and/or in the same class as the original set (e.g. representations that do not jump 
from quadratic basic semi-algebraic to SDP). We refer to characterizations that satisfy both these 
requirements as projected and class preserving. Projected and class preserving are in general in- 
compatible (e.g. the convex hull of the basic semi- algebraic set ja; G : (xf — X2)xi > 0, X2 > O} 
has no projected basic semi-algebraic representation, but has a lifted basic semi-algebraic represen- 
tation [59]). Furthermore, even giving an algebraic characterization of the boundary of the convex 
hull of a variety [62, 63] or giving a projected SDP representation of the convex hull of certain vari- 
eties and quadratic semi- algebraic sets [64, 71, 72] requires very complex techniques from algebraic 
geometry. 

In this paper we show that simple class preserving projected characterizations can be given 
for a wide range of specially structured sets. More specifically, we show how two very simple 
techniques can be used to construct projected class preserving characterizations of the convex hull 
of certain non-polyhedral non-convex sets that mimic the special structures studied in MILP. These 
special structures correspond to the difference between two convex sets with simple geometry. The 
techniques we consider are tailored to this special structure and do not require any additional 
algebraic properties (e.g. being quadratic, basic semi- algebraic, etc.). Thanks to this, the resulting 
characterizations are quite general, but give simple closed form expressions. While the structures 
we study are somewhat specific, we use them to extend split cuts to essentially all convex sets 
described by a single quadratic inequality, and to extend general intersection cuts to a wide variety 
of quadratic sets of interest to trust region and lattice problems. 

The rest of this paper is organized as follows. We begin with Section 2 where we introduce some 
notation and review some known results. Section 3 then introduces an interpolation technique that 
can be used to construct split cuts for many classes of sets including convex quadratic sets. Finally, 
Section 4 introduces an aggregation technique that can be used to construct a wide array of general 
intersection cuts. 

2 Notation, Known Results and Other Preliminaries. 

We use the following notation. Let e* G be the i-th unit vector and / G M"^" be the identity 
matrix where n is an appropriate dimension that we omit if evident from the context. We also 
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let ||x||2 := yX^ILi-^i denote the Euclidean norm of a given vector x £ M" and for a vector 

T 

V G M", we let the projection onto its span be := Tprrj and onto its orthogonal complement 

\\'"\\2 

be Pj- := I — ipW- For a set S C M", we let int (5) be its interior, conv (S") be its convex hull, 

and conv {S) be the closure of its convex hull. For a function F : M" — t- M we let epi (-F) := 
{{x,t) G M" X M : F{x) < t} be its epigraph, gr (F) := {{x,t) G M" x M : F{x) = t} be its graph, 
and hyp (F) := {{x, t) G M" x M : F{x) > t} be its hypograph. In addition, we let [n] := {1, . . . , n}. 

Definition 2.1 (Intersection and Split Cuts). Let C, S C M" be two closed convex sets and 
g : R" — )• M be an arbitrary function. We say inequality g{x) < is : 

• Fa/id for conv (CV int (S)) if conv ((:7\ int (5)) C{xGM'' : g{x)<0}, 

• an intersection cut for C and S if it is valid for conv (C \ int (S)) and g is convex, and 

• a non-trivial intersection cut for C and S if additionally {x G C : (7(2;) > 0} 7^ 0. 

We let a sp/it be a set of the form {x G M" : vr-^x G [7ro,7ri]} for some vr G \ {0} and 
ttq, TTi G M such that ttq < tti. If S" is a split, we say that the associated intersection cut is a split 
cut. If S is additionally a split with tt = e* for some i G [n], we say the associated split cut is an 
elementary split cut. 

We note that the term intersection cut was introduced by Balas [8] for the case in which 
C is a translated simplicial cone and its unique vertex is in int(S'). In this setting, we have 
that conv (C \ int (5)) is closed and can be described by adding a single linear inequality to C. 
Furthermore, this single linear inequality has a simple formula dependent on the intersections of 
the extreme rays of C with S. While we do not always have such intersection formulas for other 
classes of sets, we continue to use the term in the more general setting and avoid any additional 
qualifiers for simplicity. In particular, we do not use the term generalized intersection cut as it 
has already been used for the case of polyhedral C and S and in conjunction with an improved 
cut generation procedure for MILP [9]. The term split cut was introduced by Cook, Kannanand, 
and Schrijver [24], and their original definition directly generalizes to non-polyhedral sets as in 
Definition 2.1. 

The interest of intersection cuts for MILP and MINLP arises from the fact that if int (5) nZ^ x 
M"^ = 0, an intersection cut for C and S is valid for conv (C nW x M^). Hence, intersection cuts 
can be used to strengthen the continuous relaxation of MILP and MINLP problems. 

Intersection cuts are particularly attractive in the MILP setting, since they can be quite strong 
and can be easily constructed. They were extensively studied when they were first proposed in the 
1970s [8, 38, 39] and have recently received renewed interest [23, 31]. Part of the relative simplicity 
and effectiveness of intersection cuts for MILP stems from two basic facts. The first one is that in 
the MILP setting, C is a polyhedron (i.e. the continuous relaxation of a MILP is an LP). The second 
one is the fact that every convex set S such that int(S') n = (usually denoted a lattice free 
convex set) and that is maximal with respect to inclusion for this property is also a polyhedron [51]. 
Restricting both C and S to be polyhedra give intersection cuts for MILP several useful properties. 
For instance, if C and S are polyhedra, then conv (C \ int (5)) is a polyhedron [31]. Hence, in 
the MILP setting, we can restrict our attention to linear intersection cuts. Furthermore, if C is 
a translated simplicial cone and its unique vertex is int (5), then conv (C \ int (5)) is closed, can 
be described by adding a single linear inequality to C, and this linear inequality has a relatively 
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simple formula [8, 38, 39]. In particular, if 5 is a split and C is a polyhedron, then all linear 
intersection cuts for C and S can be constructed from simplicial relaxations of C and hence have 
simple formulas [2, 29, 69]. Gomory Mixed Integer (GMI) cuts [38, 39] and Mixed Integer Rounding 
(MIR) cuts [52, 54, 55, 70] are two versions of these formulas that have made split cuts one of the 
most effective cuts for MILP [16]. For more information on the ongoing efforts to duplicate this 
effectiveness for other lattice free polyhedra, we refer the reader to [23, 31]. In this context, we 
note that conv (C \ int (5)) can fail to be closed even if C and S are polyhedra and S is not a 
split (e.g. consider C = £M? : X2 > 0| and S = {x G : X2 < 1, xi + X2 < l}). However, 
conv (C \ int (5)) is closed in the polyhedral case if S is full-dimensional and the recession cone of 
5 is a linear subspace [4] . 

In the MINLP setting, there has been significant work on the computational use of linear split 
cuts [17, 20, 67, 33, 46]. From the theoretical side, we know that if 5 is a split, then conv {C \ int {S)) 
is closed even if C is not polyhedral [28]. With respect to formulas for intersection cuts, there has 
been some progress in the description of split cuts for quadratic sets in [6, 7, 28, 10]. Dadush et 
al. [28] show that, if C is an ellipsoid and 5 is a split, then conv (C \ int (5)) can be described by 
intersecting C with either a linear half space, a linear transformation of the second-order cone (a.k.a. 
Lorentz cone), or an ellipsoidal cylinder. In addition, they give simple closed form expressions for 
all these linear and nonlinear split cuts. Independently, [10] studies split cuts for more general 
quadratic sets, but only for splits in which {x G C : vr^x = ttq} and {x G C : vr-^x = tti} are 
bounded. They give a procedure to find the associated split cuts, but do not give closed form 
expressions for them. Finally, [6, 7] give a simple formula for an elementary split cut for the 
standard three dimensional second-order cone. While [10] develops a procedure to construct split 
cuts through a detailed algebraic analysis of quadratic constraints developed in [11], [6, 7, 28] 
give formulas for split cuts through simple geometric arguments. As we have recently shown at 
the MIP 2012 Workshop, these geometric techniques can be extended to additional quadratic and 
basic semi- algebraic sets [47]. In this paper we show that the principles behind these geometric 
arguments can be abstracted from the semi-algebraic setting to develop simple split cut formulas 
for a wider class of specially structured convex sets. This abstraction greatly simplifies the proofs 
and can be used to construct split cuts for essentially all convex sets described by a single quadratic 
inequality through simple linear algebra arguments. In addition to studying split cuts, we show 
how a commonly used aggregation technique can be used to develop formulas for general nonlinear 
intersection cuts for the case in which C and S are both non-polyhedral, but share a common 
structure. While a non-polyhedral S is not necessary in the MINLP settings (it still should be 
sufficient to consider maximal lattice free convex sets, which are polyhedral), they could still provide 
an advantage and are important in other settings such as trust region problems [12, 60] and lattice 
problems [18, 19, 53]. We finally note that similar results for the quadratic case have recently been 
independently developed in [3]. 

To describe our approach, we use the following additional definitions. Because we restrict to 
the cases in which conv (C \ int (S)) is closed, we drop the closure from the definitions. 

Definition 2.2. Let C, S* C M" be two closed convex sets and g : M" — t- M be an arbitrary function. 
We say inequality g{x) < is a: 

• Binding valid cut for conv (C \ int {S)) if it is valid and {x £ C \ int {S) : g{x) = 0} 7^ 0, 
and 

• Sufficient cut, if {x G C : g{x) < 0} C conv (C \ int(S')). 
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In this setting, we refer to C as the base set and to S as the forbidden set. 

Binding vahd cuts correspond to vahd cuts that cannot be improved by translations, and suffi- 
cient cuts arc those that are violated outside conv (C \ int(5)). We can show that a convex cut that 
is sufficient and vahd is enough to describe conv {C \ int(S')) together with the original constraints 
defining C. Our approach to generating such cuts will be to construct cuts that are binding and 
valid by design, and that have simple structures from which sufficiency can easily be proved. 

3 Nonlinear Split Cuts Through Interpolation. 

In this section we consider the case in which the base set is either the epigraph or lower level set of 
a convex function and the forbidden set corresponds to a split set. Our cut construction approach 
is based on a simple interpolation technique that can be more natiirally explained for epigraphs 
of specially structured functions. For this reason, wc begin with such a case and then consider 
special cases of non-epigraphical sets and discuss the limits of the interpolation technique. While 
the structures for which the technique yields simple formulas are quite specific, we can consider 
broader classes by considering linear transformations. Wc illustrate the power of this approach by 
showing how the interpolation technique yields formulas for split cuts for convex quadratic sets. 
For convenience, we use the following notation for the sets associated to specific classes of splits. 

Definition 3.1. Let vr G M" \ {0} , ttq, vri, ir G M be such that ttq < vri and tt / 0. 

• General Sets: For a closed convex base set C C M"' and a forbidden split set S = {x G : tt^x G [ttq, tti] } , 
we define 

C^,7ro,7ri ._ ^^^^ ^(j ^ ^ pQ^^ {{xeC: TT^X < TTq} U G C : TT^X > TTi}) . 

• Epigraphical Sets: For a closed convex base set C C M" x M and a forbidden split set 
'S'a; = {(a;, t) G X M : tt'^x G [ttctti]} that does not affect t, we define 

(j^,no,^i ^^^^ \ (5.^)^ ^ con^ (|(^^ t)eC:Tr^x< ttq} U {{x,t) e C : tt^x > tti}) , 

and for a forbidden split set Sx,t = G M" x M : tt^x + Trt G [ttojTTi]} that does affect t, 

we define 

CTT.Tr.TTcTi ._ ((27 \ int {Sx,t)) = conv ({(x, t) e C : tt'^x + 7rt < ttq} U {{x,t) e C : ifx + irt > tti}) . 

Note that in this latter case, we also allow disjunctions of the form -kt < ttq and Tct > tti for 
which TT = 0. 

• Epigraphical Sets with Elementary Disjunctions: For a closed convex base set C C 
M X X M and a forbidden elementary split set S = {{z, ?/, t) G M x x M : z E [ttq, tti]}, 
we define 

C^o.Ti — conv {C \ int (S)) = conv ({(z, y,t) e C : z < ttq} U {{z, y,t) e C : z > vn}) . 
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3.1 Epigraphical Sets with Simple Split Disjunctions. 

Let F : M — )• M be a closed convex function, 

epi{F) := {{z,t) eRxR: F{z) <t} (1) 

be its epigraph, and consider an elementary split disjunction on z. As illustrated in Figure 1(a), 
epi(i7)'ro,7ri ^ epi(F) n epi(G) for 

^ -^(^i) --^(^o) ^ I 7riF(7ro) -7roF(7ri) 




TTo TTl Z T^O 1^1 Z TTq TTl 2 

(a) Graph of F in black and graph (b) Naive friends construction. (c) Friends by following the slope, 
of G in blue. 



Figure 1: Interpolation technique for univariate functions. 

Indeed, since G is a linear function and hence epi(F) n epi(G) convex, it suffices to show that 
G{z) < t is a valid and sufficient cut. 

We can check that G{z) < t is a binding valid cut by design. Indeed, G is the (affine) linear 
interpolation of / through z = ttq and z = vri. Convexity of / then implies that this interpolation 
is below / outside z G (vtojVTi). 

To show that the cut is sufficient, we need to show that any point G epi(-F) that satisfies 

the cut is in epi(-F)'^°''^^. To achieve this, we can find two points (z'^, t*^) and (z"^, t^) in epi(i^) such 
that z° < TTo, > 71"!, and G conv , Following [30], we will denote these 

points the friends of (z, t) . One naive way to construct the friends is to wiggle (z, t) by decreasing 
and increasing z until it reaches ttq and vri, respectively. However, as illustrated in Figure 1(b), this 
can result in one of the friends falling outside epi(-F). Fortunately, as illustrated in Figure 1(c), we 
can always wiggle by following the slope of cut G to assure that the friends are at least in epi(G). 
Correctness then follows by noting that G{z) = F{z) at z = ttq and z = vri, since G{z) < t \s a, 
binding valid cut. 

The previous reasoning can be formalized for multivariate functions and general split disjunc- 
tions as follows. 
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Proposition 3.1. Let F : M" — R be a closed convex function, tt G M" \ {0}, and ttq, tti G M such 
that TTo < vTi. If G : M" — )■ M is a closed convex function such that 

G{x) = F{x) Vx s.t. vr^x G {vro,7ri} (3a) 
G{x) < F{x) Vx s.t. tt'^x ^ (7ro,7ri) , (3b) 

and if every (x, to) £ epi(G) such that vr-^x G (vtojTTi) has friends in 

{{x,t) G epi(F) : vr^x ^ (vtctti)} , 

then 

epi(F)^''^0'^i ^ gpi(^) p epi(G). (4) 

Proof. Let Q = {{x,t) G epi(F) : vr-^x ^ (vrojVri)}. We have that 

Q C epi(F) n epi(G) C conv(Q) = epi(F)'^'^0'^i ^ (5) 

where the first containment comes from (3b) and the last from the friends condition. The result 
follows by taking convex hull in (5) and noting that epi(F) n epi(G) is convex because both F and 
G are convex. □ 

Our general approach to use Proposition 3.1 is to construct a convex function that yields binding 
valid cuts (i.e. satisfies (3)) and to follow its slope to construct friends for sufficiency. We now 
consider two structures in which the appropriate interpolation can easily be constructed once we 
identify its general structure. 



3.1.1 Separable Functions. 

If F is a separable function of the form F{z,y) = f{z) + g[y) with / : M — t- M and (7 : M'^ — J- M 
closed convex functions, we can simply interpolate F parametrically on y to obtain 

^/ N -?^(vri,y) - F(7ro,y) 7riF(7ro, ?/) - 7roF(7ri, y) 

G(z, y) = z H . (6) 

TTi - TTo TTi - TTo 

In this case, the interpolation simplifies to 

r,( X /(^i) - /(t^o) , 7^1/(7^0) - TTQ /(tti) 

G[z, y) = z H h g{y), (7) 

VTi - TTo TTi - TTo 

which is convex on (z, y) and linear on z. Our original univariate argument follows through directly. 
We can then use the general version of this parametric interpolation to show the following result. 

Proposition 3.2. Let vr G M" \ {0}, ttq, tti G M such that vro < vri, 5 : R and / : M M be 

closed convex functions, 

Sgj := {(x, t) G X M : 5 [p^x) + / (vr^x) < t] , 

^ ^ /^i)-/(^o) j^j^^ 5 ^ 7ri/(^o)-^o/(^i) _ ^Yien we have that 

= { ^ S'JJ ■ 9 {Pn^) + ^^^^ + h<t]. 
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Proof. Let F{x) = g [P^x) + / (tt'^x) and G{x) = g [P^x) + avr-^x + b. Interpolation condition 
(3) holds by the definition of a and h and convexity of /. 

Now let ix, to) G epi(G) such that vr-^x G (vro, vri). To construct the friends of (x, to)) we consider 
two cases. 

Case 1. If /(ttq) = /(vri), then (x, to) can be written as a convex combination of (x'',to) and 
(x^, to) , where 



and 



.0 = P^x + ^vr 



x^ = P^x H — -^71". 

IklU 



We have that (x'^jto) , (x^,to) G epi(F) n {(x, t) : vr^x ^ (7ro,7ri)}, since vr-^x*^ = vro and vr-^x^ = vri, 
and because interpolation condition (3a) holds. 

Case 2. If /(ttq) 7^ fiT^i), (x, to) can be written as a convex combination of (x*^, t*^) and (x"*^, t^) 
given by 

x° = P^x + ^^TT, t° = to + a (tto - TT^x) , (8) 



and 

^1 
Itt 



^ = P^X H ^TT, t^ = to + a (VTI - TT^x) . (9) 

Ikll2 

Indeed, since tt'^x G (vro, vri), there exists a G (0,1) such that vr-^x = Qvro + (1 — Q)vri. One 
can check that (x,to) = a(x'',t°) + (1 — a) [x^,t^). We again have that (x°,t'^) ,(x^,t^) G 
{(x,t) Gepi(F) : vr'^x ^ (vro, vri)}, since vr^x° = vro and vr^x^ = vri, and because interpolation 
condition (3a) holds. 

The result then follows from Proposition 3.1. □ 



3.1.2 Non-Separable Positive Homogeneous Convex Functions. 

Proposition 3.1 can also be used for some non-separable functions, but as illustrated in the following 
example, we need slightly more complicated interpolations. Consider P : M x R — )• M given by 
F{z,y) = \/^^~T~y^ and let vro = —10 and vri = 1- Constructing a parametric linear interpolation 
as in (6) yields 

10^1 + y2 + y/woTy^ + z (y^l + y^ - WO + yA 
Gl{z, y) = ^ ^. (10) 

The associated cut is certainly valid, binding and sufficient (we can always find friends by wiggling 
z toward vro and vri, and using t to correct by following the slope of G for fixed y). However, while G 
is linear with respect to z, it is not convex with respect to y. We hence cannot use Proposition 3.1 
for this interpolation. Fortunately, we can construct an alternative interpolation given by 

Gciz,y) = ^^^y + y^ (11) 

that is convex on (z, y). This function is not linear on z for fixed y, but we can still show it satisfies 
the interpolation condition (3) by noting that ( 20--9z ^ ^2 ^ ^ ^-^^^^^-j that equality 
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holds for z G {7ro,7ri}. This is ihustrated in Figure 2(a) which shows that for fixed y = 4, Gc < t 
is a nonhnear binding vahd cut, but is strictly weaker than Gl < t. While Gc yields a weaker 
cut than Gl, Gc is in fact the strongest convex function that satisfies the interpolation condition 
(3) and we can show that epi(F)'^0''^i — epi(F) n epi(Gc)- However, as illustrated in Figure 2(b), 
constructing friends for (2, y , t) can no longer be done by leaving y fixed and following the slope of 
Gc or Gl to wiggle 'z towards ttq and vri. 




Figure 2: Nonlinear interpolation and friends. 



The issue with the friends construction stems from the fact that for certain fixed y, Gc is not 
linear on z. However, for any {z,y,t) such that z G (7ro,vri), we can always find a direction in 
which Gc is linear in a neighborhood of (z, y, Vj . Discovering one such direction is straightforward 
once we note that the epigraph of Gc is a convex cone. Let {z, y) be the projection of the apex 
of this cone onto {z^y) and let r = {rz,ry) be a vector that starts at this point and goes through 
{z,y) (See Figure 3(a)). As illustrated in Figure 3(b), we can then check that Gc is linear on 
{(5, y) + ra : a > 0} (Figure 3(b) shows F ((z, y) + r (1 — a)) and Gc {{z, y) + r {1 — a)) with 
such that z + Vz {1 — Oi) = tTj for i G {0, 1}). 

The friends construction can now be done by wiggling z towards ttq and vri while modifying 
y to remain in the affine subspace in which Gc is locally linear (i.e. {{z,y) + ra : a G K}), and 
modifying t to follow the slope of Gc as before. This is illustrated in Figure 3(c), which also shows 
that we can always wiggle all the way to ttq and vri as Gc fails to be linear in the subspace only 
outside z G [ttq, tti]. Alternatively, we can wiggle towards ttq and vri by following the ray that starts 
in the apex of the epigraph of Gc and goes through {z,y,tj as illustrated in Figure 3(d). 

The key in this procedure was guessing that the appropriate interpolation had the form -\/(a^+~6p~+~y2. 
After that, we could easily find the appropriate coefficients a and b, and construct a direction to 
find friends. This can be easily generalized to p-order norms by using the following simple lemma 
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whose proof is included in the appendix. 

Lemma 3.1. Let p £ N, iro,iTi G M such that ttq <0 Km, a = ^Si±^, andb = 

• If s ^ [ttq, TTi], then \as + bf < \sf , 

• if s £ {ttq, vTi}, then \as + b\^ = \s\^, and 

• if s £ (ttq, TTi), then \as + b\^ > \s\^. 

Using a similar interpolation form and Lemma 3.1, we can also calculate general split cuts for 
a wide range of positive homogeneous convex functions as follows. 

Proposition 3.3. Let vr G M" \ {0}, ttq, 7ri,/3 G M such that ttq < tti, p G N, g : M" M be a 
positive homogeneous closed convex function, a = ^'^^'"o ^ _ _ ^ttitto 

Cp,g := |(a;,t) G M" X M : (^g (^P^x)^ + |/37r^x|^) < t 

If ^ (7ro,7ri), then Cp'g°''^^ = Cp^g. Otherwise, we have that 

^pT'"' = {(^'*) e Cp,9 ■■ [a [P^^y + |a/37r^x + /Sftf)'^" < t| . 

Proof. We first show the case G (vro.vri). Let F{x) = {g{P^xY + \^Tr^xf)^^^ and G{x) = 

(g( (P^x)^ + \ a/37r'^x + (Sbf^^^. Interpolation condition (3) holds by the definition of a and b and 
Lemma 3.1. 

Now let (x, t) G epi(G) such that tt^x G (ttq, tti). To construct the friends of (x, t), we consider 
two cases. 

Case 1. If IttqI = IvTil, then the proof is analogous to case /(vro) = /(vri) in the proof of Proposi- 
tion 3.2. 

Case 2. If IttqI 7^ |7ri|, one can check that for 

. ( -b \ 



an 



all points on the ray R := {(x*, 0) + a (x — x*, to) : a G M+} belong to epi(G). Let the intersections 
of R with the hyperplanes vr-^x = ttq and tt'^x = vri be (x'^, t^) and [x^,t^^ , respectively. Such points 
are obtained from R by setting 



^0 + ^ 
ao = \ 

TT^X + ^ 
a 

and 

vri + ^ 



Ql 



a 



vr^x + ^ 



respectively. We have that [x^,t^) , (x^jt-*^) G {{x,t) G epi(P) : tt'^x ^ (vro, vri)}, since vr-^x" = vro 
and vr^x^ = vri, and because interpolation condition (3a) holds. Now note that (x,to) is obtained 
from R by setting a = 1. If < 1 < ai or ai < 1 < uq, then there exists /? G (0, 1) such that 
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(x, to) = /3 (x'', + (1 — /?) (x-^, t^) . Seeing that ir'^x G (ttq, tti), |7ro| 7^ |7ri|, and G (ttq, vti), one 
can check ao < 1 < cti or ai < 1 < ao- The result then follows from Proposition 3.1. 

Finally, consider the case ^ (vro, vri). We need to show that any point (x, to) ^ {i^, t) £ epi(F) : tt^x G (tto, tti) 
has friends in {(x,t) G epi(F) : vr^x ^ (vrcvri)}. We can construct the friends in a similar way as 
before by noting that the ray R := {a (x, to) : a €z M+} is contained in epi(-F) and intersects both 
tt'^x = ttq and vr'^x = tti- □ 

In particular, if 17 is a p-norm, the following direct corollary characterizes elementary split cuts 
for p-order cones. 

Corollary 3.1. Let e'^ be the k-th unit vector, ttq, tti G M such that ttq < vti, ||x||p = (X^iLi l^iD^''^; 

Cp := {(x,t) G M" X M+ : ||x||p < t}, 



TTl— TTO 



, 6 = and B := I + {a-l)e''e''^ . IfO ^ {tto,tti), then cf '^'''^^ = Cp. Otherwise, 

we have that 

k 

P 



C,^'-°'-^= (x,t)GC, 



Bx + be'' 



< t 

p 



3.2 Level Sets and Disjunctions Considering t. 

We have concentrated on epigraphical sets, since having t not be affected by the disjunction sim- 
plifies the friends constructions. Fortunately, the effect of t can be replicated by a positive homo- 
geneous function of variables not affected by the disjunction. With this modification, we can show 
the following proposition for non-epigraphical sets. 

Proposition 3.4. Let vr G M" \ {0}, ttq^tti G M such that ttq < vri, : M" — > M be a posi- 
tive homogeneous convex function, / : M — t- M U {+00} be a closed convex function such that 
/(vro),/(7ri) <0, 

Df^g := {x G M" : 5 [P^x) + /(vr^x) < o} , 



7-j7r,7ro,7ri 



X G Z)/,g : 5 (P^x) -havr'^x-hft < 0} . (12) 



Proof. The left to right containment in (12) holds by convexity of / and the definition of a and b. 
For the right to left containment, let x G M" be such that 



g (P^x) +aiT'^x + b<0 (13) 



and tt'^x G (vrcvri). To construct friends of x, we consider two cases. 
Case 1. If /(vTo) = /(tti), one can check that 

and 

x^ = P^x H 2 ^ 

Iklls 
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are friends of x. 

Case 2. If /(ttq) / /(tti), let a G (0, 1) be such that ■k'^x = avro + (1 — 0)111. Then x can be 
written as a convex combination of x^ and x^, where 



vr 



and 



x^ = /3^P^x + ^vr, 



vr 



for /3* := f {-Ki) / {a f {ttq) + (1 — a)/(7ri)) G [0,oo) for i G {0,1} by the assumptions on / and 
/(ttq) / /(tti). By construction, vr^x*^ = ttq and vr-^x^ = vri. To check that x* G -C>j^g, first note 
that by positive homogeneity of g we have 



g (P^^x^) + f (vr^x^) = g ( P-x ) + /(vr,). 

V / ^ ^ a/(7ro) + (1 - a)/(7ri) 



(14) 



If /(vTj) = 0, then we directly obtain g (P^x^) +/ (tt^x^) < 0. Otherwise, if /{ni) < 0, (14) implies 
that g (P^x*) + / (tt^x*) < is equivalent to g (P^x) + a/(7ro) + (1 - a)/(vri) < 0, which holds 
because of (13) and af{7ro) + (1 — a)/(7ri) = an'^x + b. 

The result then follows from convexity of g (P^x) + avr^x + 6, similar to the proof of Proposi- 
tion 3.1. □ 

As a direct corollary of Proposition 3.4, we obtain formulas for elementary split cuts for balls 
of p-norms. 

Corollary 3.2. Let be the k-th unit vector, 7ro,7ri,r G M such that ttq < tti, r > 0, and 
kol , Kil < r, 

Bp := {x G M" : ||x||p < r}, 
f(u) ■= - (r-P - \u\Pf'P, a = b = ^^f(^o)-nof{n,) ^nd B := I - e^e^'^ . Then 



TTl— TTQ 







|x G Pp : 


Px 



Proof. Direct from Proposition 3.4 by noting that 



Br, 



X G 



Bx 



+ oxfc + 6 < ^ . 



+ /(xfc) <0 



□ 



From the proof of Proposition 3.4, we can glimpse a natural extension of Proposition 3.4 to 
general non-epigraphical sets. We do not explore such extension further, since we have not yet 
encountered non-epigraphical structures beyond that of Proposition 3.4 which allow for simple 
split cut characterizations. However, we consider the following direct extension of Proposition 3.1 
as we need it to give a complete characterization of split cuts for convex quadratic sets. We will see 
in Section 3.3.2 that the resulting formulas are significantly more complicated than those obtained 
through Proposition 3.1. 
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Proposition 3.5. Let F : M" — ?• R be a closed convex function, vr € M", 7ro,7ri,-n" G M such that 
VTo < TTi and vr 7^ 0. If G : M" — t- M is a closed convex function such that 

{ix,t) € gr(F) : vr'^x + vrt = ttq} = G gr(G) : vr^x + vrt = ttq} (15a) 

{ (x, t) G gr (F) : vr^x + vrt = vri } = { (x, t) G gr(G) : vr^x + M = tti} (15b) 

{(x,t) G epi(F) : vr^x + vrt ^ (vtctti)} C {{x,t) G epi(G) : ir'^x + nt ^ (ttctti)} , (15c) 

and if every (x, to) £ epi(G) such that vr-^x + nto G (ttq, tti) has friends in 

{(x,t) G epi(F) : vr^x + vrt ^ (ttcvti)} , 

then 

epi(F)^'*'^«'''i = epi(F) n epi(G). (16) 
3.3 Split Cuts for Quadratic Sets. 

In this section we consider split cuts for convex sets described by a single quadratic inequality. 
Since we also want to include the second-order cone, we also consider quadratic sets that are the 
union of two convex sets and can be separated by a single linear inequality. It is well known (e.g. 
see [11] Section 2.1) that all such convex quadratic sets correspond to the following list: 

1. A full dimensional paraboloid, 

2. a full dimensional ellipsoid (or a single point), 

3. a full dimensional second-order cone, 

4. one side of a full dimensional hyperboloid of two sheets, 

5. a cylinder generated by a lower-dimensional version of one of the previous sets, or 

6. an invertible affine transformation of one of the previous sets. 

To give formulas for split cuts for all the above sets, it suffices to give formulas for the cases 
1-4. With these, we can construct formulas for cylinders by using the following straightforward 
lemma. 

Lemma 3.2. Let C C M" and let L C M" be a linear subspace. Then conv {C + L) = conv (C) + L. 

Finally, split cuts for afhne transformations can be obtained through the following simple lemma 
that we prove in the appendix. We include an epigraphical version of this lemma, since it will 
simplify the formulas in some cases. 

Lemma 3.3. Let c G M", tt G M" \ {0} , ttq, tti G M such that ttq < tti, B £ R"'^"- be an invertible 
matrix, vr = B~^it, ttq = ttq — tt'^c, tti = tti — vr^c, and /, g, f,g : M" — )• R U {+00} be proper closed 
convex functions such that /(x) = / {B{x — c)) and g{x) = g {B{x — c)). // 

/ ~\ TT, Sol's"! / ~\ 

epi [fj = epi [f j ^ epi [g] , 

then epi (J)'^''^0''^i = epi (/) n epi {g). Similarly, if 

X G M" : /(x) < 0| = |x G M" : /(x) < 0, g{x) < o| , 

then {x G M" : /(x) < 0}^'^«'''^ = {x G M" : /(x) < 0, g{x) < 0}. 
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We first consider split cuts for quadratic sets with simple structures that can be obtained as 
direct corollaries of Propositions 3.2, 3.3 and 3.4. We refer to these as simple split cuts. We then 
consider split cuts for sets with more complicated structures that require ad-hoc proofs based on 
Propositions 3.1 or 3.5. As expected, we will see that formulas for the first case are significantly 
simpler than those for the second case. However, in either case, it is crucial to exploit the symmetry 
of the Euclidean norm through the following well known lemma. 

Lemma 3.4. For v G M", ||a;||2 = ||P^x||2 + ||P^x||2. 



3.3.1 Simple Split Cuts. 



Simple split cuts can be obtained for general ellipsoids and for paraboloids and cones that, when 
interpreted as epigraphs of quadratic or conic functions (i.e. based on the Euclidean norm), are 
such that t is unaffected by the split disjunctions. We note that the ellipsoid case has already 
been proven on [10, 28], and that the conic case generalizes Proposition 2 in [7] which considers 
elementary disjunctions for the standard three dimensional second-order cone. 



Corollary 3.3 (Simple split cuts for paraboloids). Let B G 
vr G \ {0}, VTo, VTi G M such that ttq < vri, 



he an invertible matrix, c G M", 



LC"^ {B,c) := {{x,t) G 



: \\B{x-c)\\l <t} 



||B-T^||2 



^ ^ _ (z^qjK^^C^ B = pj-^B. Then 



LC^ {B, c) 



{x,t) £ LC^ {B,c) : B{x-c) 



+ avr (x 



b<t 



Proof. Using Lemma 3.3, we prove the corollary by finding a closed form expression for LC^ (/, 0)'^''^°''^^ , 
where vr = B~'^7r, tto = ttq — tt'^c, and tti = tti — ir'^c. By Lemma 3.4, we have LC^ (I, 0) = 

\{x,t) G M" X M+ : ||P^x||| + < t\. The result then follows from Proposition 3.2. □ 



Corollary 3.4 (Simple split cuts for cones). Let B G 
vr G \ {0}, VTo, VTi G M such that ttq < vri, 



be an invertible matrix, c G 



LC {B, c) := {{x, t) G X M+ : \\B {x - c) II2 < t} , 

a = ^i+^o-2.^c ^ ^ -2(.,^.^c)(^o-^^e) g ^ +aPs-T^B, andc= fft/ ||i?-^7r||'') P-^TT. 

Ifir'^c ^ (7ro,7ri), then LC {B ,cY''^°''^^ = LC {B,c). Otherwise, we have that 



LC{B,cf''''''^' = {(x,t) G LC{B, 



B(x-c)+c 



< t 



}■ 



Proof. Using Lemma 3.3, we prove the corollary by finding a closed form expression for LC {I, 0)'^''^°''^^ , 
where vf = B~^tt, ttq = ttq — tt'^c, and fri = vri — tt^c. By Lemma 3.4, we have LC (I, 0) = 



{x,t) G M" X M+ : WP^-xWi + 



Ml 



T_.\2\ 1/2 



< t>. The result then follows using Proposition 3.3. 



□ 
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A particularly interesting application of Corollaries 3.3 and 3.4 is the Closest Vector Problem 

[53], which can be alternatively written as min I II i? (x — c) II 2 : x G Z"| or min{||i? (x — c)||2 : x G Z"}. 

In turn, these problems can be reformulated as min |t : (x, t) G LC^ (B, c) , x G and min {t : (x, t) G LC {B, i 
respectively. We can then use Corollaries 3.3 and 3.4 with lattice free splits to construct cuts that 
could improve the solution speed of these problems. We are currently studying the effectiveness of 
such cuts. 

We can also obtain as a corollary the following result from [10, 28]. 

Corollary 3.5 (General split cuts for ellipsoids). Let B G M"^" be an invertihle matrix, c G , 
TT G M" \ {0}, r G M+, 

E {B, c, r) := {x G M" : \\B (x - c) ||2 < r} , 



7ro,7ri G M such that ttq < vri, f{u) := —yf — pj^r^; 

(vTi - vr^c) /(tto - vr^c) - (tto - vr^c) /(vri - vr'^c) 



TTi - TTo 

and a 

TT^ r' — T II R^^'TtIi^ 



/ (tto — TT^ c) — / (tTI — TT"^ c) 
TTl— TTO 

// vr-^c — r ||i3~"^7r|| < ttq < vri < '''""^c + r ||i?~'^7r|| , i/ien 



S (5, c, r)^'^«'^i = {x G ^ (B, c, r) : HPi-r^S (x - c) lb < a^^(x - c) - , (17) 



if T^Q < c — r^B -^7r||2 < TTl < TT-^c + r -^vrll^, i/ien 

7r,7ro,7ri _ ( ^ rp ( r, 



E {B, c, r)^'^«'''i = {x G ^ (5, c, r) : vr^x > tti} , (18) 



if TT^c — r 1 1 i3 "^vr jj^ < ttq < 7r"^c + r||i? "^vr 1 1 ^ < tti , iften 

^ (S, c, r)^'^«'''^ = {x G S (S, c, r) : vr^x < ttq} , (19) 

i/ vr-^c — r ||i?~-^7r||2 > vri or ttq > tt'^c + r \\B'''^7r\\^, then E {B, c,r)^'^°'^^ = E{B,c,r), and 
otherwise, E {B,c,r)^'^'^'^^ =0. 

Proof. Using Lemma 3.3, we prove (17) by finding a closed form expression for E {l,0,r)'^'^°'^^ , 
where tt = i?~^7r, ttq = ttq — ir'^c, and vri = '''"i — vr^^c. By Lemma 3.4, we have E [1, 0, r) = 

X G M" : ||P^x||2 — y^r^ — ^ o|>. The result then follows from Proposition 3.4. 

The other cases can be shown by studying when the ellipsoid is partially or completely contained 
in one side of the disjunction, or when it is completely contained strictly between the disjunctions. 

□ 

We note that Corollary 3.5 shows there are two types of split cuts for E{B,c,r). In (17), 
we obtain a nonlinear split cut that we would expect from Proposition 3.4, while in (18)-(19) we 
obtain simple linear split cuts. These linear inequalities are actually Chvatal-Gomory (CG) cuts for 
E {B, c, r) [21, 26, 27, 32, 37], but they are still sufficient to describe E (B, c, r^'^^''^^ together with 
the original constraint. We hence follow the same MILP convention used in [28] and still consider 
them split cuts. Finally, we note that we can also consider "CG split cuts" in Proposition 3.4 if we 
include additional structure on the functions such as g being non-negative. Similarly, we can also 
do the case analysis for CG cuts in Corollary 3.2. 
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3.3.2 Other Split Cuts. 

The split cut formulas in this section are significantly more complicated. For this reason, we only 
present them for standard sets (i.e. with B = I and c = 0). Formulas for the general case may be 
obtained by combining the formulas for the standard case with Lemma 3.3. 

Proposition 3.6 (General split cuts for paraboloids). Let vr G M", ttq, vti, tt G M such that ttq < vri 
and vr / 0, 

LC^ (1,0) := {{x,t) G R" X M+ : ||x||^ < t]. 
If vr > and vto < tti < , or if vr < and — < vro < vri , then 



if vr > and vro < < "^i) then 

LC^ {1, 0)"'*'"0'"i = {{x,t)e LC^ (/, 0) : vr^x + vrt > vri } 

if vr < and vro < -^m^ < > then 

LC^ (/, o)^'*'^0'^i = {(x,t)£ LC"^ {1,0): vr^x + vrt < vro } 

and if vr > and < vrg < vri , or if vr < and vro < vri < V , then 



LC^ {1,0) 



477 



Tr.TTjTTQ ,7ri 



(x,i) G LC^ (/,0) : 



vr'^x + b 



-vr 



vr 



< cvr X + (it + e 



for 



(20) 



vr 



2vr 



/ 



\/2 (vri - vro) tt 
d = cvr 



I'^Wl + V Il'''"ll2 + 47rovrY/||vr||2 + 4vrivr 



4\/2 (vri — vro) vi"^ 



/ 



/ = Y Ikll2 + 2 (vro + vri) vr - y lk||2 + ^vrovry ||vr||2 + 4vrivi-, 
where we use the convention 0/0 := for the case ||vr||2 = 0. 

Proof. We include the case analysis in Lemma 5.1 in the appendix. All the cases above except the 
last one follow from Lemma 5.1. Now consider the last case where vr > and ^ < vro < vri, or 
vr < and vro < vri < -p^- We prove this case using Proposition 3.5. 



Let F{x) = \\x\\2 and G{x) 



CTT^x — e I /d. One can check that f,d>0. 
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Now we consider two cases. 
Case 1. Assume that ||7r||2 / 0. First, we prove (15a). Let Sp '■= {{x,t) G gr(F) : Tr'^x + irt = vro} 
and Sg '■= {{x,t) G gr(G) : ir'^x + frt = vro}. To prove Sq C Sp, let {x,to) G Sq- We need to show 
that ||x||2 = to. By squaring the spht cut equahty and using Lemma 3.4, we can equivalently show 
that 

/ T ,- \2 (tt'^x + b) _ (tt'^x) , ^ 

{cTT^x + dto + e) ' =^0- II ii2 ■ (21) 

IfI|2 IfII2 

Replacing to with (vro — vr^x) /tt, one can check that (21) follows from the definition of h, c, d, and 
e. 

To prove Sp ^ Sq, let (x,to) £ "^f- We only need to show that ck^x + dio + e > 0. Since 
d = CTT, we need to show that c (vr-^x + vrto) > — e, which after a few simplifications, can be written 
as 

vr (vr^x + TTto) > - ^||7r||2 + \\tt\\1 + ^ttqt^^J Wt^WI + ^vrivr^ /4. (22) 

II 11^ 

(22) follows from noting that min {vr (tt-^x + vrt) : (x, t) G LC^(/, 0)} = — J^^. Proving (15b) is 
anologous. 

Now we prove (15c). Let Sp '■= {{x,t) G epi(F) : -ir'^x + vrt ^ (7ro,vri)} and So '■= {{x,t) G 
epi(G) : tt'^x + Ttt ^ (ttojTTi)}. To prove Sp Q Sg, let (x,?o) G Sp. To show that (x,to) satisfies 
the split cut inequality (20), we can show that 

Uc-K^x + dto + e) - ^ II 1 - II ||2 1^0- (23) 

One can check that proving (23) is equivalent to showing that 

P {tt^x + Trio — TTo) (tt'^x + Trio — tti) 



2 (tTi — TTo)^ TT^ 



> 0, 



which follows from vr^x + Trio ^ (ttq, tti). Proving ctt'^x + dto + e > is similar as before. 

Now let (x, to) G epi(G) such that vr-^x + yrto G (ttq, tti). To construct the friends of (x, to), one 
can check that for 

* _ -b * _ bc-e 

II ii9 ^' I ' 

IKII2 ^ 

all points on the ray R := {(x*, t*) + a (x — x*, to — t*) : a G M+} belong to epi(G). Let the in- 
tersections of R with the hyperplanes tt'^x + M = ttq and vr^x + yrt = vri be [x^,t^) and (x^,t^), 
respectively. Such points are obtained from R by setting 

vro + /i 



vr^x + vrto + h 
and 

VTi + /l 



vr^x + vrto + /i' 



respectively, where = MlWMl+^^onV\\-f,+4.in _ ^^^^ ^^^^ ^^o^^O) ^ (^i^^i) ^ ^p^^^) ^ 
|(x, t) : vr-^x + vrt ^ (vtq, vri)}, since vr^x^+vrt'^ = ttq and vr^x^+'n't^ = vri, and because interpolation 
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conditions (15a) and (15b) hold. Now note that {x, to) is obtained from R by setting a = 1. If oq < 
1 < ai or Qi < 1 < ao, then there exists /3 G (0, 1) such that (x, to) = /3 (2;°,*°) + (1 - /3) (x^t^). 
Seeing that vr^x + vrto £ (ttq, vti), one can check ao < 1 < cki or ai < 1 < ao- 



Case 2. If ||7r||2 = 0, the split cut (20) is simplified to ||x||2 < dt + e. Let G{x) 



e)/d. 



One can prove (15a) and (15b) by showing that for (x,to) £ epi(F) such that vrto G {vtojVTi}, 
we have {dtQ + h)^ = Iq. The latter follows from the definition of the interpolation coefficients. 
Non-negativity of d,e, and t also imply dto + e > 0. Proving (15c) is also equivalent to showing 
that 

f (TTto - TTq) {TTtp - TTi) ^ ^ 
2 (vTi — TTo)^ TT^ 

which follows from vrto ^ (vrojVri). 

We can construct the friends in a similar way as in Case 1 by noting that the ray R := 
{(0, t*) + a (x, to — t*) : a G K+j, where t* = is contained in epi(G) and intersects both yrt = ttq 
and vrt = vTi. 

The result then follows from Proposition 3.5. 

□ 

Proposition 3.7 (General split cuts for cones). Let vr € M", 7ro,7ri,7r G M such that ttq < tti and 
tt/O, 

LC(/,0) := {(x,t) € M" X M+ : ||x||2 < t}. 
If ^ (^0,^1), then LC7(/,0)^'*'^°'^^ = LC{I,0). Otherwise, if G (7ro,7ri) and vr < -\\tt\\2, then 

LC(/,0)™O'^i = {(x,t) ELC (7,0) :7r^x + 7rt<7ro}, 
if G (vrojTTi) and n > ||vr||2, then 

LC (1, 0)^'*'^0'^i = { (x, t) e LC (/, 0) : TT^x + TTt > ^1 } , 
and if G (vto, tti) and vr G (— ||7r||2 , llTrUg), then 

air'^x + 6 



LC(/,0) 



7r,7r,7r() ,7ri 



(x,t) G LC(/,0) : 



P^x + 



-vr 



< CTT x + dt + e 



where 



(tto + VTi) (^llvrllg - tt' 
/ 

27ro7ri ||7r||2 

7 

47rovri7r 

(vTi - TTo) / 

/ 

(vTi - TTo) (^||7r||2 - 

27ro7ri (ttq + tti) vr 

(vTi - TTo) / 



f = J (lkll2 - (lkll2 (^0 - vri)^ - (vro + tti)^ tt^^ . 
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Proof. We include the case analysis in Lemma 5.2 in the appendix. The second and third cases 
where G (ttojVTi) and vr < — ||vr||2 or vr > ||vr||2 follow from Lemma 5.2. 

Now we show the case G (vro, vri) and vr £ (— ||7r|| , ||vr||). Note that vr / and vr G (— ||7r|| , ||7r||) 

imply ||7r||2 7^ 0. Let F{x) = \\x\\2 and G{x) = ^ P-it^ + "^^ys'^ '^ ~ ctt'^x ~ ^ Z*^- One can check 

that d > 0. Similarly to the proof of Proposition 3.6, we can show that interpolation condition (15) 
holds by the definition of a, b, c, d, and e. 

Now let (x, to) G epi(G) such that tt'^x + vrto G (■''"Oj^ti). To construct the friends of {x,io), we 
consider two cases. 

Case 1. If IvTol = |7ri|, (x,to) can be written as a convex combination of (^x^,t^^ and [x^,t^^ 
given by 



[1 - 3-) 



, ,|2 



d 



and 



1 I TTi — vrto — tTttt-^x 1 _ c (vr'^x — vr'^a;-'^) , ^ 

^ =^^^+^7^ TTvi^^^, t^=to + ^ (25) 



Indeed, since vr'^x + vrfo G (ttq, tti), there exists a G (0, 1) such that tt^x + Trto = otto + (1 — 0)111. 
One can check that (x,to) = a (x°,t°) + (1 - a) We also have that (x°,t°) , (x\t^) G 

epi(F) n {(x,t) : tt-^x + vrt ^ (ttcvti)}, since vr-^x" + Trt" = ttq and tt'^x^ + = vri, and because 
interpolation conditions (15a) and (15b) hold. 
Case 2. If IttqI 7^ |7ri|, one can check that for 



a vr 



-h ^ be — ae 

— n vr, t - 



ad 



all points on the ray R := {{x* ,t*) + a {x — x* ,io — t*) : a G M+} belong to epi(G). Let the in- 
tersections of R with the hyperplanes tt'^x + vrt = ttq and vr^x + yrt = vri be (^x^,t^^ and (x^,t^), 
respectively. Such points are obtained from R by setting 



"0 



vr^x + vrto + /i 
and 

TTl + h 

ai 



respectively, where /i = We again have that (x°, t") , (x^, t"*^) G epi(F)n{(x, t) : vr'^x + vrt ^ (ttq, 

since vr^x'' + vrt" = ttq and vr-^x^ + vrt^ = vri, and because interpolation conditions (15a) and 
(15b) hold. Now note that (x,to) is obtained from R by setting a = 1. If ao < 1 < ai or 
cti < 1 < ao, then there exists (3 G (0,1) such that (x,to) = /3(x°,t'^) + (1 — /3) (x^,^-'^). Seeing 
that tt'^x + TTto G (ttctti), IttqI 7^ |7ri|, and G (ttctti), one can check ao < 1 < ai or ai < 1 < ao- 
The result then follows from Proposition 3.5. 

Finally, consider the case ^ (7ro,7ri). We need to show that any point (x,to) ^ epi(F) n 
{{x,t) : TT-^x + vrt G (ttq, vri)} has friends in epi(F)n{(x, t) : vr^x + vrt ^ (7ro,7ri)}. We can construct 
the friends in a similar way as before by noting that the ray R := {a (x, to) : a ^ 1^+} is contained 
in epi(F) and intersects both tt'^x + ift = ttq and tt'^x + M = tti. □ 
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Proposition 3.8 (Simple split cuts for hyperboloids). Let vr G M" \ {0}, ttq,tti,1 G M such that 
VTo < vTi and / / 0, 

H := I {x, t) G X K+ 



|x||^ + Z2 <t}. 



If IvTol = IvTil, then 



H 



TTjTTQ ,7ri 



G i/ : 



<t}, 



where b = \/ P ||7r||2 + irf, and if |7ro| ^ |7ri|, then 



(x,t) G H : 



air'^x + b 



-IT 



< t 



where 



'2^2 + ^2 + ^2 _ 2 /(^2 ||^||2 + ^2\ ^2 ||^||2 + ^2 



TTi - VTo 



/2 ||^||2 - vrovri + J(/2 ||vr||2 + (/2 ||^||2 + ^2^ 



VTo + TTi 



Proof. We first show the case |7ro| = Ivril. Let F{x) 



-a. 



+ /2 and G{x) 



Interpolation condition (3) holds by the definition of b. Now let (x, to) G epi(G) such that tt'^x G 
(ttojVTi). We can construct the friends of (x, to) in a similar way as in Case 1 in the proof of 
Proposition 3.3. The result then follows from Proposition 3.1. 

Now consider the case |7ro| / |7ri|. Let G{x) = P^x + n'a"^ '^ • Interpolation condition (3) 

IKII2 2 

holds by the definition of a and b. 

Now let (x, to) G epi(G) such that tt'^x G (ttojTTi). We can construct the friends of (x, to) in a 
similar way as in Case 2 in the proof of Proposition 3.3. The result then follows from Proposition 3.1. 

□ 

We have partially generalized Proposition 3.8 to general split cuts for hyperboloids. However, 
in most cases, the resulting formulas are unmanageably complicated, so we did not pursue this 
further. 



4 General Intersection Cuts Through Aggregation. 

In this section we consider the case in which the base sets are either epigraphs or lower level sets 
of convex functions and the forbidden sets are hypographs or upper level sets of concave functions. 
Our cut construction approach in this case is based on a simple aggregation technique, which again 
can be more naturally explained for epigraphs of specially structured functions. Following the 
structure of Section 3, we also begin by studying the epigraphical sets and then consider the case 
of non-epigraphical sets. We also end the section by illustrating the power and limitations of the 
approach by considering intersection cuts for quadratic constraints. 
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4.1 Intersection Cuts for Epigraphs. 

Let G:MxR— T-Mbea convex and a concave function given by F{z, y) 
G{z,y) = -{z - 1)2 + 1 - and let 



+ 2y2 and 



epi(F) = {{z,y,t) : F{z,y) < t} and hyp(G) = {{z,y,t) : t < G{z,y)} 



be the epigraph of F and the hypograph of G, respectively. For A G [0,1], let Hx{z,y) = (1 — 
X)F + AG. As illustrated in Figure 4(a), for any A € [0,1], we have that Hx{z,y) < t is a 
binding valid cut for epi(F) \ int (hyp(G)). However, depending on the choice of A, the inequality 
could be non-convex, or it could be convex but not sufficient. It is clear from Figure 4(a) that 
in this case, the correct choice of A is 1/2 = argmax{A G [0, 1] : Hx is convex}, which yields the 
strongest convex cut from this class. Furthermore, as illustrated in Figure 4(b), we have that for 
any (z, y, t) G epi(-ffi/2) H int (hyp(G)), we can find friends in epi(F) \int (hyp(G)) by following the 
slope of Hi/2 similar to what we did for split cuts of separable functions. We can then show that 



conv (epi(F) \ int (hyp(G))) = epi(F) n epi {H1/2) . 
A similar construction can also be obtained if we instead study conv {{{z, y, t) £ epi(F) : G{z, y) < 0}). 



Hx and the convexity requirement on it are the basis of many techniques such as Lagrangian/SDP 
relaxations of quadratic programming problems [35, 57, 60, 61], the QCR method for integer 
quadratic programming [13, 14], and an algorithm for constructing projected SDP representa- 
tions of the convex hull of quadratic constraints introduced in [71]. It is hence not surprising that 
the approach works in the quadratic case. However, as shown in [71], even in the quadratic case 
the approach can fail to yield convex constraints or closed form expressions. Furthermore, for gen- 
eral functions, Hx can easily be non-convex for every A. Fortunately, as the following proposition 
shows, the approach can yield closed form expressions for general intersection cuts for problems 
with special structures 

Proposition 4.1. Let : M — )• M be convex functions for each i E [n], m,l E R", r, g G M, and 
7 G M+. Furthermore, let {aj}"=i Q M" be such that a-n 7^ and ai _L aj for every i 7^ j, and 
{ai}"=x — ^+ such that / a„ > Qj for all i. Let 



n 




n 




G := epi(F), and S := {{x,t) e W x R : 7^ < G{x)}. If (1 + 7/a„) > and 



lim -anQn (sa^an) - s \ l 




On +7 



(m - l/anf a, 



1 +l/an 



"n 



) 



= —00 



(26) 



then 



conv (C \ int {S)) = conv ({(x, t) G epi(F) : G{x) < -ft}) = epi(F) n epi(iJ), 



(27) 
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where 



^ F{x) + {l/an)G{x) ^ (1 - aj/an) Qi jafx) + {m-l/ Unf x + {r - q/an) 

Proof. The first equahty in (27) is direct. For the second equality, we proceed as follows. H \s a, 
non-negative linear combination of F and G that is also a convex function from which it is easy to 
see that the left to right containment holds. 

To show the right to left containment, let (x, t) G epi(F) n epi(i/) be such that G {x) > yi. 

Let k = ''"'^y^/'^ • Because of (26), there exits si > and S2 < 0, for which = 
(x + Sian,t + Sik) for i = 1, 2 are such that G (x*) = 7f*. Furthermore, by design (x*, t^) G epi(F) 
for i = 1, 2, which implies F (x*) + G (x*) /a„ < (1 + ^ /ctn) and hence F (x*) < i*. The result 
then follows by noting that (x, t) G conv (| (x^, t"*^) , (x^, t^) |) . □ 

4.2 Intersection Cuts for Level Sets. 

In contrast to the split cut case, we cannot use positive homogeneous functions to play the role 
of t in non-epigraphical sets. Nevertheless, we can extend the aggregation approach to certain 
non-epigraphical sets through the following proposition whose proof is a direct analog to that of 
Proposition 4.1. 

Proposition 4.2. Let : M — t- M be convex functions for each i G [n], m G M", r, g G M. 
Furthermore, let {ai}'^^^ C M" be such that an ^ and Oj _L aj for every i / j, and {oj}"^]^ C M_|_ 
be such that 7^ a„ > Oj for all i. Let 



F(x) = (^f ^) + m-^x + r, 

i=l 

n 

G'(x) = - ^ aiS'j {ajx) - Onm^x - q, 



i=l 



C := {x G M" : F(x) < 0}, and S := {x £ M" : G(x) > 0}. If 



lim -angn {sa^an) - sanin^an = -00, (29) 

|s|— >-oo 



then 



/ ( F(x) < 0, 1 \ ( F(x) < 0,1 

conv (C \ .n. (5)) = conv (^|. . «» : " ^ | j = |. , M» : ^J^J " ^ | , (30) 

where 

n-l 

ff(x) := F(x) + (l/a„)G(x) = ^{1- at/an) Qi {afx) + (r - q/an). (31) 

i=l 

The special structure in both of these propositions is extremely simple, but thanks to the sym- 
metry of quadratic constraints, they can be used to get formulas for several quadratic intersection 
cuts. 



21 



4.3 Intersection Cuts for Quadratic Sets. 

Corollary 4.1. Let B € M"^"- he an invertible matrix, A G M"'^", c, d G 
1-/'^ yj-j , . — X M_|_ : II _B (x — c) || 2 ^ 

and 



LC^ (5,c) := {{x,t) G M" X M+ : ||B(x - 
S ■= |(x,t) GM"xM:7t + g< - p(x-d)f } 



Then 



for 



{\\B (x — c)|P < t 
(x,t) gM" xM+ : ^ " ^ ^ ^" ~ 
x^ Ex + X + f < {an + j)t 



E = B' HE, 
a = -2B'^e - 2B^HBc, 



f = c^B^HBc + 2 {B^e) c-w-q, 



n-l 



H = ^{an- ai) ViV, 

i=l 
n 

e = aivf B{c — d) 



T 

i 1 



1=1 



W 



^a. [vjB{c-d))\ 



i=l 



(32) 



where (tij)"^^ C and (aj)"^^ ^ M correspond to an eigenvalue decomposition of B ^A^AB ^ 



so 



that 



B-'^A^AB-' = 



(XiVivf, 



i=l 



\\vi\\2 = 1 for all i, vjvj = for all i 7^ j, and an > ai for all i. 

Proof. Let y = B{x — c) and T := LC^ {B, c) \ int (5). Using orthonormality of the vectors Vi, T 
can be written on the y variables as 



T = < 



(y, G M" X M+ : 



i=l 



> . 



^ ai {vjy)^ - 2e^y - w - q < jt 



1=1 



The result then follows by using Proposition 4.1. 



□ 
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An interesting case of Corollary 4.1 arises when 7 = 0. In this case, the base set C corre- 
sponds to a paraboloid and the forbidden set S corresponds to an ellipsoidal cylinder. In such 
a case, the minimization of t over (x, t) G C \ int {S) is equivalent to the minimization of a con- 
vex quadratic function outside an ellipsoid, which corresponds to the simplest indefinite version 
of the well known trust region problem. While this is a non-convex optimization problem, it can 
be solved in polynomial time through Lagrangian/SDP approaches [60]. It is known that optimal 
dual multipliers of an SDP relaxation of a non-convex quadratic programming problem such as the 
trust region problem can be used to construct a finite convex quadratic optimization problem with 
the same optimal value as the original non-convex problem (e.g. [36]). Furthermore, the complete 
feasible region induced by a SDP relaxation on the original variable space (in this case {x,t)) can 
be characterizes by an infinite number of convex quadratic constraints [48]. This characterization 
has recently been simplified for the feasible region of the trust region problem in [12]. This work 
gives a semi-infinite characterization of T for 7 = composed by the convex quadratic constraint 
||-B(x — c)||^ < t plus an infinite number of linear inequalities that can be separated in polyno- 
mial time. Corollary 4.1 shows that these linear inequalities can be subsumed by a single convex 
quadratic constraint, which gives another explanation for their polynomial time separability. We 
note that the techniques in [12] are also adapted to other non-convex optimization problems (both 
quadratic and non-quadratic). Hence, combining Corollary 4.1 with these techniques could yield 
valid convex quadratic inequalities for more general non-convex problems. 

Another interesting application of Corollary 4.1 for the case 7 = is the Shortest Vector Problem 
(SVP) [53] of the form min | \\Bxf : x G \ {0}|. Similar to the Closest Vector Problems (CVP) 
studied in Section 3.3.1, we can transform this problem to rnin^^. j^ggpij-^nxK) * for 

Q = |(x,t) G M" X M+ : \\Bxf < t, x / o| , 

so that we can strengthen the problem by generating valid inequalities for Q. Unfortunately, as 
the following simple lemma shows, traditional split cuts will not add any strength. 

Lemma 4.1. Let Qo = Qu{{0, 0)}. For any B G M"^", 

t* = minjt : (x,t) G n(^^^„)gznxz Qq''"''''""^^} = 0- 

Proof. Note that for all integer splits (vr, ttq) G Z" x Z, (x, to) = (0, 0) belongs to one side of the 
disjunctions. Thus, we have t* < and the result follows from non-negativity of the norm. □ 

However, we can easily construct near lattice free ellipsoids centered at that do not contain 
any point from 17^ \ {0} in their interior, and use them to get some bound improvement. For 
instance, in the trivial case oi B = I, Corollary 4.1 applied to the single near lattice free ellipsoid 
given by the unit ball {x G M" : ||x||2 < 1} yields a cut that provides the optimal value t* = 1. 
Similar ellipsoids could be used to generate strong convex quadratic valid inequalities for non-trivial 
cases to significantly speed up the solution of SVP problems. Studying the effectiveness of these 
cuts is left for future research. 

We end this section with a brief discussion about the strength and possible extensions of the 
aggregation technique. For this, we begin by presenting the following corollary of Proposition 4.2 
whose proof is analogous to that of Corollary 4.1. 
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Corollary 4.2. Let B € M"""" be an invertibk matrix, A £ M"^", c G M", ri,r2 € M+, 

{B, c, n) := {x G M" : \\B (x - c) ||i < n} , 

and 

5:= |xGR" : ||5(x-c)||^ > rz} . 
T/ien i/iere exist a positive semi-definite matrix E £ M"^", a £ M", and / G M sitc/i i/iai 

conv(ii;2(i?,c,ri)\int(5)) = LgMV ^ 11^ " c) II2 < 1 ^33^ 

[ X Ex + a X + f <0 J 

Corollary 4.2 shows how to construct the convex hull of the set obtained by removing an ellipsoid 
or an ellipsoidal cylinder from an ellipsoid. However, this construction only works if the ellipsoids 
have a common center c. The following example shows how the construction can fail for non- 
common centers. In addition, the example shows that the aggregation technique does not subsume 
the interpolation technique and sheds some light into the relationship between Corollaries 4.1 and 
4.2 and SDP relaxations for quadratic programming. 

Example 4.1. Consider the set C = {{z,y) : + y"^ < 4| and the split disjunction z < OVz > 1. 
From Corollary 3.5, we have that 

C7°'^ := conv {{{z, y) £ C : z < 0} U {{z,y) £ C : z > 1}) 
= \^{z,y) : z^ + y^ <A, |y| < (^/3 - 2) z + 2} . 

Now let F{z,y) = z'^ + y'^ -A and G{z,y) = -(2-1/2)2 + 1/4. Since split disjunction z < OVz > 1 
is equivalent to G{z, y) < 0, we have 

CO'i = conv {{{z,y) £ : F{z,y) < 0, G{z,y) < O}) . (34) 



Now consider Hx = (1 — X)F + AG. One can check that the split cut \y\ < (v3 — 2j z + 2 obtained 
through Corollary 3.5, can be equivalently written as 



y^ - (^(^VS - 2j z + 2j <0 (35a) 
V3 - 2) z + 2 > 0. (35b) 



In turn, (35a) is equivalent to Hx* < for X* = (6 — \/3) because Hx* / {-^ (9 + 4\/3)) = 
y"^ — ((\/3 — 2) z + 2) . By noting that (35b) holds for C, we conclude that 

C"^'^ = {{z,y)£R^ : z^ + y^ <A, Hx*{z,y)<0}. (36) 

Unfortunately, Hx* is not a convex function, so it does not fit in the aggregation framework de- 
scribed in this section. In particular, Hx* is an indefinite quadratic function so it cannot be obtained 
from a SDP relaxation of {{z,y) £ : F{z,y) < 0, G{z,y) < O}. Indeed, we can show that the 
SDP relaxation of {{z,y) £ M? : F{z,y) < 0, G{z,y) < O} strictly contains C°'^ Finally, while 
we can obtain Hx* through a procedure described in [71], this procedure requires the execution 
of a numerical algorithm and does not give closed form expressions such as those provided by 
Corollary 3.5. 
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5 APPENDIX: Omitted proof and auxiliary lemmas. 

Lemma 3.1. Let p G N, vrcvn G M such that ttq < < tti, a = ^si+m and b = 

• If s ^ [ttctti], i/ien |os + < jsj^, 

• if s E {ttq, TTi}, i/ien |as + = |s|^, and 

• if s E (ttq, TTi), i/ien |as + > 

Proof. We prove the lemma for p = 2 only. The same result follows for any p G N by taking the 
appropriate power of both sides of the inequalities. 

Let p = 2. Consider the quadratic equation (as + b)'^ — = 0. One can sec that s = ttq 
and s = TTi solve the equation above. With some rearrangements, this quadratic equation can be 
written as ia^ — l) + 2ahs + 6^ = 0, where - 1 = , ^^o^\^ < 0. The result follows from noting 

V ' (vri-Tro) " 

that {a? - l) + 2abs + 6^ < for s ^ [vo, vri], and {a? - l) + 2abs + 6^ > for s G (ttq, tti). 

□ 

Lemma 3.3. Let c eW.-K eW \ {0} , ttq, tti G M such that ttq < tti, B g M"^" 6e an invertible 
matrix, tt = B~^Tr, ttq = ttq — tt'^c, tti = tti — tt-^c, and /, g,f,g ■ — >■ M U {+00} be proper closed 
convex functions such that f{x) = f {B(x — c)) and g(x) = g {B{x — c)). // 

epi [fj = epi (^/j n epi (5) , 

i/ien epi {ff^'^^^'^^ = epi (/) n epi {g). Similarly, if 

ja; G : f{x) < o| = ja; G : /(x) < 0, g{x) < o| , 

then {x G M" : /(x) < 0}'''''°'''i = {x G : /(x) < 0, g{x) < 0}. 
Proof. We prove the first case only. The second case is analogous. Let 

^0 := {{x,t) G epi(/) : tt^x < ttq} , Si := G epi(/) : n'^x > tti} , 

and 

So := G epi (/) : tt^x < ttq} , Si := {(x,i) G (/) : tt^x > tti} . 

By definition, /'^''^o.^n ^ conv (^o USi). To show that conv(S'o U S"!) C epi(/) n epi(c^), take 

{x,to) e conv(5o U Si). There exist (x°,t°) G 5o and (x\t^) G 5*1 such that (x,to) = a(x°,t°) + 
(1 - a) ix^,t^) for some a G [0, 1]. Then {B (x* - c) ,f ) G 5^ for i G {1, 2} and hence 



a {B (x° - c) + (1 - a) (5 (x^ - c) ,t^) = {B {x - c) ,to) G epi (/) 



7r,7ro,7ri 



Then by assumption, {B {x — c) ,to) G epi ( / ) n epi {g) and the result follows from the definition 
of / and g. 
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For the reverse inclusion, take (x, to) G epi(/) fl epi{g). Then {B {x — c) , to) G epi ^/^ fl epi {g) 

and by assumption, there exist G 5o and {x^,t^) G Si such that {B {x — c) , to) = a{x'^, + 

(1 - a) {x^,t^) for some a G [0, 1]. Thus, 

X = B-^ (ax° + (1 - a) x^) + c and at" + (1 - a) = to- 

The result then follows by noting that [B'^x^ + c,i°) G So and (fi-^x^ + c,t^) G Si. 



□ 



Lemma 5.1. Lei tt G M", ttq, tti, tt G M suc/i t/iat ttq < tti and ir 7^ 0. Also define 

LC^ {1, 0) := G x M+ : ||x||2 < t} , 

So := {(.x,t) G LC^ (/,0) : tt^x + vrt < ttq}, and Si := {{x,t) G LC^ (/, 0) : tt^x + irt > tti}. 

• //tt > and TTo < TTi < then So = and Si = LC^ (/, 0), 

• «/7r > and TTo < =^ < tti, then So = 0, Si C LC^ {1,0), and Si ^ 0, 

• ifTT>0 and < ttq < ^1, t/ien So, Si C LC^ (/, 0) and So, Si ^ 0, 

• i/ TT < and TTo < TTi < then So, Si C LC^ {1, 0) and So, Si 7^ 0, 



i/TT < and ttq < < m, then Si = 0, Sq C LC^ (1, 0), and So / 0, 



47f 

l|2 



TT < and < TTo < tti, t/ten Si = and So = LC^ (/, 0). 

Proof. We prove the first three cases only. The other cases are analogous. First, consider the case 

— II iP 

that TT > and ttq < vri < . If ||7r||2 = 0, the result follows from non-negativity of t. Now 

assume that HvrUg 7^ 0. Note that if So 7^ 0, one can find (x,to) ^ So such that (vr-^x)^/ ||vr||2 < 
(ttq — vr-^x) /tt. Therefore, we prove So = by showing that (vr^x)^ / ||vr||2 > (ttq — n'^x) /tt. This 
follows from noting that for y G R, the quadratic equation Tpjjj = ^"^^ does not have any solution. 

Il'^ll2 

To prove Si = LC^ (-^jO), we show that tt^x + irt > tti is a valid inequality for LC^ (-^jO). This 

2 

comes from the fact that the quadratic equation = ^^^^ has at most a single solution and as 

a result, we have (tti — tt'^x) /tt < (vr-^x)^ / ||vr||2 < t. 

— II ll'^ 

Now consider the second case that tt > and vro < ^ < tti. Proving Sq = is analogous 
to the previous case. We have Si C LC^(/, 0), since (x,to) = "^4^^ ^ LC"^ {!,{)), but 

(x,to) ^ Si. To prove Si / 0, one can check that for any x G M" and to = Max|||x||2 , ""^"^^^^ j, 
(x,to) G Si. 

—II 11^ 

Finally, consider the third case that tt > and ^ < ttq < tti. To prove So, Si C LC^ (/, 0), 
one can see that (x,to) = + ^) G (1,0), but (x,to) ^ Sq U Si. Proving Si = 

is analogous to the previous case. Now we prove So 7^ 0. If ||7r||2 = 0, one can note that 
(x,to) = (0,0) G So. If ||7r||2 7^ 0, one can check that (x,to) = (jHlf''"' ^"t^) ^ '^O' '^'^ere 
y = ll^llz \/ll^|2+^lkll _2![o![ ^ solution to the quadratic equation = ^"^^ . □ 
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Lemma 5.2. Let tt G M", ttq, tti, tt G M swc/t t/jat ttq < < tti and tc ^ 0. Also define 

LC {I, 0) := {(.T, t) e M"* X M+ : ||x||2 < t} , 

50 := {ix,t) G LC{I,0) : Tr'^x + nt < ttq}, and Si := G LC(/,0) : ir'^x + nt > tti}. 

• //tt > ||7r||2, t/ien = 0, 5i C LC(I,0), and Si ^ 0, 

• ifTr<- ||7r||2, t/ien Si = 0, So C LC{I,0), and So ^ 0, 

• «/7r G (- ||7r||2 , ||7r||2), then Sq,Si C LC (7,0) and So, Si ^ ill. 

Proof. First, we prove the case that -k > \\7t\\2- If ||7r||2 = 0, the result follows from non-negativity 
of t. Now assume that ||vr||2 7^ 0. Note that if So 7^ 0, one can find {x,io) G Sq such that 
(n'^x)^ / IKII2 — ('''"0 ~ tt'^x)'^ /'ft'^. Therefore, we prove So = by showing that (vr'^rc)^ / IKII2 > 
(ttq — vr-^x)^ /vr^. Note that non- negativity of t and tt, together with tt'^x + vrt < ttq imply tt'^x < 
TTo < 0. One can see that ir^x < ttq — tt^x < — vr^ x, where the first inequality follows from 
tt'^x < TTo and —ir'^x > 0, and the second inequality comes from the fact that tto < 0. Thus, 
(tt'^x) > (tto — tt'^x) and the result follows by noting that jj;^ > . We have Si C LC (7, 0) , 

since {x,to) = (0,0) G LC (1,0), but {x,to) ^ Si. To prove Si 7^ 0, one can check that for any 
xGM" andfo = Max|||x||2,^^i^^}, (x,to) G ^i. 

Now consider the second case that vr < — ||7r||2- Again for ||vr||2 = 0, the result follows from 
non-negativity of t. Now assume that ||7r||2 7^ 0. Note that if Si 7^ 0, one can find (xAq) G 

51 such that (vr-^x)^ / ||7r||2 < (tti — vr^x) ^ /vr^ . Therefore, we prove 5i = by showing that 

(tt'^x)^ / IKII2 > (^1 ~ T^^x)'^ /tt^. Note that non-negativity oi t, tt < 0, and n'^x + nt > tti imply 
TT-^x > TTl > 0. One can see that —tt^x < tti — ir^x < ir'^x, where the first inequality comes from 
the fact that vri > 0, and the second inequality follows from tti < vr'^x and —tt'^x < 0. Thus, 
(tt'^x) > (vTi — vr-^x) and the result follows by noting that > Jy- We have Sq £ LC (7,0), 

since (x,to) = (0,0) G LC (7,0), but (x, to) ^ 'S'o- To prove So 7^ 0, one can check that for any 
X G M" and to = Max |||x||2 , ^^^^^j, (x,to) G S'o- 

Finally, consider the last case that tt G (— ||7r||2 , ||vr||2). Note that -n- 7^ and tt G (||7r||2 , ||vr||2) 
imply ||7r||2 7^ 0. We have S'o, Si C LC (7, 0), since (x, to) = (0, 0) G LC (7, 0), but (x, to) ^ So U Si. 
To prove So, Si 7^ 0, one can check that for 



kll2(lkll2 -■^) ' Ikll2-^' 

and 

1 _ TTl 1 _ TTl 

— II II /II II ^ 

lF||2(lF||2 + 7r) 



we have (x°,t°) G So and (x\t^) G Si. 



□ 
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(a) Level sets of Gc in blue and ray r in purple, (b) Graphs of F and Gc in black and blue plotted in the 

direction in which Gc is locally linear. 





(c) Friends by following the slope of Gc- 



ao tti a 

(d) Friends by using the fact that epi (Gc) is a cone. 



Figure 3: Friends construction for positive homogeneous non-separable functions. 
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Figure 4: Cuts from aggregation. 
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